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Abstract 

In this article, we investigate the problem of simultaneously steering an uncountable family of finite 
dimensional time-varying linear systems. We call this class of control problems Ensemble Control, a 
notion coming from the study of spin dynamics in Nuclear Magnetic Resonance (NMR) spectroscopy 
and imaging (MRI). This subject involves controlling a continuum of parameterized dynamical systems 
with the same open-loop control input. From a viewpoint of mathematical control theory, this class of 
problems is challenging because it requires steering a continuum of dynamical systems between points 
of interest in an infinite dimensional state space by use of the same control function. The existence of 
such a control raises fundamental questions of ensemble controllability. We derive the necessary and 
sufficient controllability conditions and an accompanying analytical optimal control law for ensemble 
control of time-varying linear systems. We show that ensemble controllability is in connection with 
singular values of the operator characterizing the system dynamics. In addition, we study the problem 
of optimal ensemble control of harmonic oscillators to demonstrate our main results. We show that the 
optimal solutions are pertinent to the study of time-frequency limited signals and prolate spheroidal 
wave functions. A systematic study of ensemble control systems has immediate applications to systems 
with parameter uncertainties as well as to broad areas of quantum control systems as arising in coherent 
spectroscopy and quantum information processing. The new mathematical structures appearing in such 
problems are an excellent motivation for new developments in control theory. 
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I. Introduction 

State-of-the-art quantum technology can trap and experiment with individual atoms, image 
brains as well as generate structural and dynamical information of biological macromolecules. 
Numerous applications arising from such emerging techniques involve controlling a large quan- 
tum ensemble, e.g., on the order of Avogadro number (6 x 10^^), by use of the same control field 
[1], [2], [3], [4], [5], [6], [7], [8], [9], [10], [11]. In many cases, the elements of the ensemble show 
variations in the values of parameters characterizing the system dynamics, and hence the system 
Hamiltonians of different elements of the ensemble are distinct. This phenomenon results in a 
dispersion in the system dynamics. For example, in magnetic resonance experiments, the spins of 
an ensemble may have large dispersions in their natural frequencies (Larmor dispersion), strength 
of the applied radio frequency (RF) field (RF inhomogeneity), and the dissipation rates of the 
spins [12], [13], [14]. In solid state NMR spectroscopy of powder, the random distribution of the 
orientations of intemuclear vectors of coupled spins within an ensemble leads to a distribution 
of coupling strengths [15]. 

A canonical problem among these applications is to develop excitations (control signals) that 
will steer such an ensemble of systems with different dynamics from an initial state to a desired 
final state in finite time using a time-varying electromagnetic pulse. From the perspective of 
mathematical control theory, this is a very challenging state transfer problem because it requires 
steering a continuum of dynamical systems between points of interest in an infinite dimensional 
state space with the same control function. This motivates the study of Ensemble Control and 
the notion of ensemble controllability [1], [2], [3], [4], [5], [6] described as follows. 

Consider a parameterized family of control systems 

j^Xit,s)=FiXit,s),uit),t,s), (1) 

X eM cW, se D cW^, ueU cW", 

where F is a smooth function of its arguments and D is a compact subset of M^. Different values 
of the parameter s in ([1]) correspond distinct members of the ensemble X{t, s) showing variations, 
but we are constrained to use the same open-loop control u{t) to steer the whole ensemble. The 
existence of such a control raises fundamental questions of ensemble controllability. The formal 
definition will be given in Section UIl In practice, such control designs are called compensating 
pulse sequences as they can compensate for or are insensitive to the dispersion in system 



October 28, 2008 



DRAFT 



3 



dynamics. Typical applications include the design of excitation and inversion pulses in NMR 
spectroscopy in the presence of Larmor dispersion and RF inhomogeneity [9], [10], [11], [12], 
[13], [16], [17], the transfer of coherence between a coupled spin ensemble with variations in the 
coupling strengths [18], and the construction of slice selective pulses in MRI, where some spins 
of the ensemble are excited or inverted while the others remain unaffected [19], [20], [21], [22], 
[23], [24], [25]. Practical considerations, such as power constraints and signal or information 
losses due to relaxation effects, make it desirable to construct pulses that achieve a desired level 
of compensation with minimum energy or in the shortest possible time. These considerations 
give rise to problems in optimal control of ensembles. These pulse design problems are widely 
studied in NMR spectroscopy on the subject of composite pulses that correct the dispersion in 
system dynamics [12], [16], [17], [26], [27], [28]. However, a systematic study of the design 
of compensating pulse sequences has been missing. The research in Ensemble Control will give 
explicit answers to the questions of when a compensation for the system dynamics is possible 
and how, if possible, to achieve the desired level of compensation. 

More generally, ensemble control provides a framework to devise open-loop controls that are 
robust to parameter uncertainties, namely, they are insensitive to parameters. In many control 
applications, an accurate model is not available and systems have unknown parameters. They 
either have some level of uncertainty or are not deterministic, however, there are instead bounds or 
distributions that describe these parameters. For example, systems biology models have numerous 
parameters, such as kinetic constants, which are unknown or only weakly constrained by existing 
experimental knowledge [29]. In chaotic dynamics, the problem of parameter uncertainties 
is unavoidable in synchronizing chaotic systems [30]. In such scenarios, one aims to design 
controllers that are robust to these parameter uncertainties. Subjects on robust control theory 
and sliding mode control are well studied to design controllers that can control or stabilize 
such systems using "feedback" [31], [32]. While effective, these controllers are closed-loop and 
dependent on measurement of the system state - at times a difficult, or impossible requirement. 
Ensemble control, rather, provides a systematic framework for the design of open-loop controls 
that are immune to parameters and robust to uncertainties. 

This paper is organized as follows. In the following section, we review ensemble control 
problems and the notion of ensemble controllability. We summarize our previous work of steering 
an ensemble of systems evolving on SO(3) to highlight the basics of ensemble control. Simple 
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examples of ensemble control of linear systems are addressed to motivate the need of developing 
ensemble controllability conditions. In Section Unl we present our main results of necessary 
and sufficient controllability conditions for ensemble control of finite-dimensional time-varying 
linear systems. Finally, we study optimal control of an ensemble of harmonic oscillators as 
a demonstration of our main results as well as provide an insight of how ensemble control 
framework can be adopted to deal with systems with parameter uncertainties. We show that this 
system is ensemble controllable and the optimal control of such a system is pertinent to the study 
of time-frequency limited signals and prolate spheroidal wave functions (pswf). We present both 
analytical and numerical solutions. 



In this section, we review the basics of the ensemble control and the notion of ensemble 
controllability [3], [6]. Ensemble Control involves problems of simultaneously manipulating a 
continuum of dynamical systems with different internal and external dynamics by use of the 
same open-loop control input. The general form of an ensemble control system is shown as in 
(dl), and standard linear and bilinear ensemble control systems are of the respective forms 



The investigation of what kind of dispersions s in the system dynamics can and cannot be 
corrected is a subject of fundamental and practical importance. This raises interesting questions 
of ensemble controllability. 

Definition 1: Consider a family of control systems as in ([T]). This family is called ensemble 
controllable on the function space L^dD, M) if and only if for all £ > and for all Xq, Xp E 
Loo{D, M), there exists T > and an open-loop piecewise-continuous control u : [0,T] ^ U 
such that starting from any initial state Xo(s) = X(0,s), the final state Xt{s) = X{T,s) G 
Loo(-D, M) satisfies \\Xt — Xir||oo < 

Note that T G (0, oo) may depend on e, D, and the bound of the control amplitude. The idea 
of ensemble controllability is illustrated in Figure [U^a). 

Remark 1: Note that ensemble control systems are different from distributed parameter sys- 
tems where the systems are governed by partial differential equations [33]. The difference can 



II. Basics of Ensemble Control 



d 
di 
d_ 
di 



X{t, s) = A{t, s)X{t, s) + B{t, s)u{t), 
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(a) 



S 



(b) 



Fig. 1. (a) Illustration of the idea of ensemble controllability. Xo(s) and X{T,s) are two points on the function 
space Loo{D, M), which correspond to two functions on the s — X domain. If there exists a u{t) that steers the 
system ([T]i from an initial point Xo{s) to X{T, s) £ Bs{Xp{s)), for some finite time T, then the system is ensemble 
controllable, (b) The idea of the polynomial approximation, where the constant function 9{e) = 1 is approximated 
by an odd polynomial of degree 2n + 1, i.e., J2k=o ^k^'^^^^ ~ 1 for all e e [1 — 5, 1 + 5]. 

be seen from the fact that in ([T]) there is no partial derivative term with respect to the second 
variable, 1^. Ensemble control is also different from robust control in the sense that in ensemble 

' OS 

control one is interested in devising an open-loop control signal, u{t), that is insensitive to the 
state variable x and the parameter s, while in most cases of robust control designs, constructing 
a closed-loop feedback control is of interest [34]. 

A. The Prototype of Ensemble Control Problem 

The prototype of ensemble control problem was presented in our previous work, that is, control 
of a continuum of systems on S0(3) [3], [6], 



where X G S0{?>), {uj,e) E D = [a,h] x [c, rf] G M x R+, and VL^^Vty^Vtz are generators 
of rotation around x, y, and z axis, respectively. This system is ensemble controllable on the 
function space S{D), the set of all S0(3) valued measurable functions defined on D. We also 
showed through the study of this system that generating higher order Lie brackets by use of the 
control vector fields which carry higher order powers of the dispersion parameters is a key to 
investigating ensemble controllability. As a result, the infinite dimensional control problem can 
be translated to the problem of polynomial approximation. In this example, we can synthesize 



X(t,Lj,e) = uQz + ^u^y + ^vQx X(t,u!,e 



), X(0,u;,e: 
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new generators of rotations by successive Lie bracketing of {ijQz,^^y,^^x} and then produce 
{uj, e) -dependent evolutions of the form, 

^ I k ^ 

This evolution can then be used to approximate the desired evolution, exp{6'(ti;, e)^^;}, with 
dependence on (u;, e) by appropriate choice of c^/'s, where 9{lu, e) is a measurable function over 
D. 

The idea of polynomial approximation is shown in Figure [IJb). Based on this concept, a result 
on ensemble controllability of a simple linear system is immediately evident. 
Example 1: An ensemble of time-invariant linear systems 

X{t, s) = AX{t, s) + sBu{t), 

where s G [si, Sa] C R, A G M"^" and B G M"'''", is not ensemble controllable [6]. 

Proof. Observe that 

m 

sBu = sukb'', 

k=l 

where b'' is the kth column of B. We can think of b'' as constant vector fields that generate 
translations. Since 6*^ all commute to one another, their Lie brackets do not generate terms 
carrying higher powers of the dispersion parameter s. Therefore, the system is not ensemble 
controllable. Note that this result can also be easily verified by applying the variation of constants 
formula. □ 
The above example shows that the inability to synthesize higher powers of the dispersion 
parameter by successive Lie bracketing makes this system not ensemble controllable. The fol- 
lowing fact characterizes a necessary controllability condition for a family of single-input linear 
systems. 

Theorem 1: Consider a family (A{s),b{s)) of linear single-input controllable systems 

X{t, s) = A{s)X{t, s) + b{s)u{t), 

where s takes values from a finite set D C R, A{s) e R"""", b{s) G R", and u : [0,T] R, 
T < oo. If the system is controllable, then there are no repeated eigenvalues of A{s) for all s 
[3]. 
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Remark 2: For the linear single-input controllable system (yl(s), 6(s)), it is required that 
rank A[s) >n — l, and the equality holds when A{s) contains at least one eigenvalue equal to 
since det A{s) — 0. However, the condition that there are no repeated eigenvalues among all 
A{s) restricts the ensemble to contain at most one singular A{s). 

These examples motivate the need of developing general controllability conditions. In the fol- 
lowing section, we investigate necessary and sufficient controllability conditions for an ensemble 
of finite dimensional time-varying linear systems. We show that these conditions are associated 
with the singular value representation of the linear operator characterizing system dynamics. 

III. Linear Operators and Ensemble Controllability 

The main result of this article is to provide the necessary and sufficient controllability condi- 
tions for an ensemble of general finite dimensional time-varying linear systems of the form 

j^X{t, s) = A{t, s)X{t, s) + B{t, s)u{t), (2) 

where A{t, s) and B{t, s) are n x n and n x m matrices, respectively, whose elements are 
complex- valued L2 functions defined on a compact set D = [0,T] x [si,S2] C M^, denoted 
as A e L2^'^(D) and B e L2^™(D). In this case, the ensemble controllability conditions are 
associated with when there exists an open-loop control, u E L^[0,T], which will steer the whole 
ensemble X between points of interest in the function space Lgfsi, 52]- 

Let's start with some standard control theoretic analysis for the above system. Consider a 
fixed finite time T, starting from an initial state X{0,s) we have by the variation of constants 
formula 

X{T, s) = $(r, 0; s)X{0, s)+ [ $(r, r; s)B{t, s)u{T)dT, (3) 

Jo 

where 0; s) is the transition matrix for ■^X{t, s) — A{t, s)X{t, s). It is known that for each 

S e [si,S2] 

0;s)=/-F / A{ai,s)dai+ / A{ai,s) / A{a2, s)da2dai 
Jo Jo Jo 

pt PUl P(T2 

+ / A{ai,s) / A{a2,s) / A{a3, s)da3da2dai + . . . , 

Jo Jto Jto 

is the Peano-Baker series which is uniformly convergent [35]. Given a desired target state Xf{s) 
and an £ > 0, we wish to find a control u{t) such that ||X(T', s) — Xi;'(s)||2 < £. A simple 
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manipulation of ([3]) yields 

$(0,r;s)5(r,s)M(r)rfr = e(s), (4) 



where 

e(s) = $(0,T; s)Xf{s)-X{Q,s), 

and ^(s) is known as long as the initial and target states are specified. Note that for now we 
consider X{T,s) = Xp(s). Let Hi = L™[0,T] be the set of m-tuples, whose elements are 
complex vector-valued square-integrable measurable functions defined on < t < T, with an 
inner product defined by 

{9,h)m = [ 9Kt)h{t)dt, (5) 
where f denotes the conjugate transpose. Let 7-^2 = L2[si, S2] equipped with an inner product 



S2 



{P,(l)n2 = / p\s)q{s)ds. (6) 



It is clear that, with well-defined addition and scalar multiplication, Hi and H2 are separable 
Hilbert spaces. Now we define L : Hi ^ H2 hy 

{Lu){s)= f ^0,T;s)B{T,s)u{T)dT, 
Jo 

and hence from ^ 

iLu)is)=as). (7) 

Denote B{Hi,H2) as the set of bounded linear operators from Hi to H2- It is then easy to verify 
that L E B(Hi,H2) (see Appendix U). Consequently, L has the adjoint L* satisfying 

(/, Lu)^,^ = {L*f, u)^^ , WfeH2,ueHi. 

This gives, by ([5]), and the Fubini's theorem, 

^ f{s)(f $(0,r;s)5(r,s)n(r)dr) rfs= / f / ' [fi^(r, s)$^(0, r; ^ ds) M(r)dr 



T 

t 



{L*fYu{T)dT. 







Therefore, 



{L*f){t) = r B\t,s)^\Q,t-s)f{s)ds. (8) 
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The study of ensemble controllability for this system boils down to the problem of solving the 
inverse problem as in ([7]). With the above analysis, we show the main result of this paper. 
Theorem 2: Consider a parameterized family of finite dimensional time- varying linear systems 

s) = A{t, s)X{t, s) + B{t, s)u{t), (9) 

where X : D ^ M", D = [0, T] x [si,S2] C and u e L^; A e Lf''{D), B e Lf'^iD), 
and time-varying {A, B) are controllable pairs for all s. This family is ensemble controllable on 
the function space L^isi, S2\ if and only if 



5:%>^<oo (10) 



n=l 



n 



(ii) ee7^(L), (11) 

where (a^, fJ^n, ^n) is a singular system of L. Moreover, the control law 
satisfies 

< (Mo,Mo) 

for all uq E U and uq ^ u, where U = \^v\ Lv = ^ with (i) and (ii)}. In addition, 

N{e) 



is the best approximation of u for a given £ > 0, namely, uj^ is such that ||^ — Lum\ < ^ for 
all m > N{e), where 



Ur. 



Ill 



■ 1 ^3 



Before proving the above theorem, we need the following preliminary tools. 

A. Preliminaries 

Proposition 1: The operator L : Tii ^ I-L2 defined by 



(Ln) (s) = f $(0, r; s)5(r, s)u{T)dT, 
Jo 
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is compact. 

Proof. See Appendix HI 

Theorem 3 (Spectral Theorem [36]): Let X be a Hilbert space and A : X ^ X he a compact 
self adjoint operator. Then there exist a, possibly finite, sequence {/i„} of nonzero eigenvalues 
of K and a corresponding orthonormal sequence {0n} of eigenvectors such that for each x E X, 
Ax = fJ^nix, 4>n)4'n, whcrc the sum is a finite sum if there are only finitely many eigenvalues. 
Moreover if {/i„} is an infinite sequence, then it converges to zero. 

Definition 2 (Singular System [37]): Let X and Y be Hilbert spaces and K : X ^ Y he a 
compact operator. If (cr^, z/„) is an eigensystem of KK* and (cr^, is an eigensystem of K*K, 
namely, KK*Un = cr^i^n and K*Kiin = cTnl^n, where o-„ > > 1), and the two systems are 
related by the equations 



we say that (cr„,/i„, z/„) is a singular system of K. 

Remark 3: Since K is compact and then we know KK* and K*K are both compact, self- 
adjoint, and nonnegative operators. Thus by the Spectral theorem, K*K can be represented in 
terms of its positive eigenvalues, namely, we have K*Kx = Yl,n^n{^^ l^n) IJ^n for all x E X. 
Moreover, since K*Kiin = <^nl^n, the relations as in (fT2)) follow by taking z/^ = -^Kjin- This 
can be treated as the infinite dimensional analogue of the singular value decomposition of a 
matrix. 

The above definition immediately gives rise to the following results. 

Proposition 2: Let X and Y he Hilbert spaces and K : X ^ Y he a compact operator. If 
{an, fJ^n, ^n) is a singular system of K, then 

(i) {/^n} is an orthonormal basis of TZ{K*), 

(ii) {z/„} is an orthonormal basis of 1Z{K). 

Proof, (i) Since /i„ = ■\K*Kfin G TZ{K*K) and K*K is compact and self adjoint, the Spectral 
theorem, K*Kx = cr'j{x, iJ,j)iJ,j, for all x E X, implies that span{fin} is dense in TZ{K*K). 
It follows that span{fin} = 'Tl{K*K) = TZ{K*). (ii) can be proved similarly. □ 
Theorem 4 (Singular value expansion [37]): Let X and Y he Hilbert spaces, K : X ^ Y he 
a compact operator and {{a, fin, i^n) \ n ^ A} be a singular system for K. Then 



K*U, 



n 



(12) 
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for all X E X, y eY. In particular, if 

n 

KnX = '^^aj{x, fij)i'j, X E X, 
i=i 

and K is of infinite rank, namely, A = N, then 

II — i^„|| < sup (Tj — i> as n — > oo. 

j>n 



Proof. Since, by Proposition [2l {z/„} is an orthonormal basis of 71{K), the Fourier expansion 
gives for all x G X 

= ^{Kx,Uj)iyj = ^{x,K*iyj)uj = ^aj{x, iJ,j)iyj. 
j j j 

The other part can be shown similarly. Also, we have 

\\{K - Kn) xW^ = II ^(Tj(x,/ij>jf = ^ |(Tjf |(x,/ij)p <sup a] \\x\\' 

Therefore, 



II — i^nll < sup (Tj ^ as n ^ oo, 

j>n 

since cr^ is an eigenvalue of K*K and — > as n — > oo. □ 
Theorem 5 (Riesz-Fischer Theorem [37]): Let {ui, U2, . . .} be an orthonormal set in a Hilbert 
space X and let be a sequence of scalars. Then 

oo oo 

|a„P converges if and only if ^a„M„ converges, 

n=l n=l 

and, in that case, 

oo 

a„ = (x, Un) Vn G N, where x = ^ 

n=l 

Theorem 6 (Minimum Norm [38]): Let G and H be Hilbert spaces and let A E B{G, H) with 
range closed in H. Then, the vector x of minimum norm satisfying Ax = y is given by a; = A*z 
where z is any solution of AA*z = y and A* is the adjoint operator of A. 

Proof of Theorem^ Necessity: Since L is compact by Proposition [H we then let (an, jJ^i, ^n) 
be a singular system of L. Now suppose that u{t) is a solution to ([7]) and u E Hi. Then 
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Hence, {u, fin) = ^(^, t'n)- By the application of Bessel's inequality to u and the orthonormal 
system {/in}, we have 



oo 



E\{C:^n)\'^ 1/ \|2 ^ II ||2 ^ 



n=l '^^ n=l 



Furthermore, for any rj E Af{L*), i.e., L*r] = and rj G H2, we have 

{^,r]) = {Lu,r]) = {u,L*r]) = 0. 



Therefore, ^ G Ar(L*)^ = 7^(L). 

Sufficiency: Conversely, we suppose that both conditions (i) and (ii) are satisfied. Let a„ = 
-^{^,t^n), hence I'^nP converges according to the condition (i). By the Riesz-Fischer 

theorem, there exists a m G TYi so that 



00 

u = 

n=l 

and then 



^ttn/Un, (13) 



a„ = {U, fin) = — l^n) ■ (14) 



Note that u G Mi^L)^ C Tii since {fin} spans 1Z{L*). Hence, from Theorem |4] and (fT4)) . we 
obtain 

00 00 

Lm = ^an(M,/in)l^n = ^(C, i^n)^'n- (15) 
n=l n=l 



Since ^ G 7^(i^) by the condition (ii) and {un} spans ^^{L) by Proposition [21 ^ can be expressed 
by the Fourier expansion, 

oo 



n=l 

Combining this with (flSl) and (fT3l) . we conclude that 



oo ^ 

M = '^n)/in, (16) 

n=l 

u G J\f{L)^ C Til, is a solution of (|7]). We now put 

^ 1 



Mat — / , ^j/^j, 
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oo 



Lu — Lu 



'N 



2 



(t| Km, — > as N ^ oo. 



j=N+l 



Therefore, given any £ > 0, we can find un such that ||,^ — LuAr|| < e for an appropriate choice 
of = N^e). Moreover, since u E J\f{L)-^ = 1Z{L*), according to Theorem [6l u is of minimum 
norm satisfying (|7]), that is. 



Remark 4: The controllability condition (i) implies that an ensemble control law exists if and 
only if the Fourier coefficients (,^, z/„) with respect to the singular functions Vn decay fast enough 
relative to the singular values (T„. Note that (a^, z/„) is an eigensystem of the Hermitian operator 
LU : 7^2 ^ ^2 defined by 



an analogy of the classical controllability Gramian. The ensemble controllability condition (i) 
coincides with the so called Picard criterion in the literature of integral equations. 

Corollary 1: For any given initial state Xo(s) = X(0,s), the ensemble control law u as in 
(fT6l) does not depend continuously on the target state Xp{^s). 

Proof. Suppose that 5„ is a perturbation of ^ with (5„ ^ as n ^ oo and that = ^ + 5^. Let 
u and Un are solutions to the integral equations Lu = ^ and Lun = ^n, respectively. We now 
consider a qualified perturbation 5„ = a^/dni^n, where a G M. It is clear that 5„ — ^ as n oo 
because {z/„} is an orthonormal basis and cr„ ^ as n ^ oo. Thus, we have 



{u,u) < {uo,Uo) 



for all uq eU and uq ^ u, where U = {v\Lv = with (i) and (ii)}. 



□ 



{LL*z){s) = / / 

Jsi Jo 



r; (t)z{(j) drda, 




as 



n 



oo. 



However, 
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and hence 




Therefore, the control u doesn't depend continuously on ^(s) and thus neither on the target state 

X^(s) = $(T,0;s)[e(s) + Xo(s)]. □ 

IV. Optimal Control of An Ensemble of Harmonic Oscillators 

In this section, we study in detail the ensemble control of a family of harmonic oscillators that 
demonstrates our main results in Section Unl We show that this system is ensemble controllable 
and derive an analytical optimal control law. The analysis of this ensemble control system is 
related to the study of time-frequency limited signals and prolate spheroidal wave functions. 
Alternatively, this problem can be viewed as control of a harmonic oscillator with parameter 
uncertainty, where the frequency is unknown but only its range is provided. 



A. Unconstrained Optimal Ensemble Control 

We first look at a fixed end-point optimal ensemble control problem without constraints on 
the control signals. 

Problem 1: Consider an ensemble of harmonic oscillators with a variation in their natural 
frequencies 

d x(t,Lj) —u x(t,Lj) uit) 

T, = ' ' + ' , (17) 

dt y y{t,uj) J [ ^ J [ yit^^) J [ 

where uj e D = [uji,uj2] C M, X{-,uj) = (a;(-, cj), ?/(■, cj))^ G Ll{D), and U = {u,v)'^ G 
[0,T]. Find controls u{t) and v{t) that steer this continuum of systems from an initial state 
Xq = (x(0, iu),y{0, uj)Y to within a ball of radius e around the final state Xp = {xF{uj),yF{^jj)Y 
at time T < oo, and minimize the cost functional 

J= j [u{tf + v{tf]dt. (18) 
Jo 

We first observe that each element of the ensemble in (|17l) with a frequency uj E D h 
controllable, because the Gramian matrix is of full rank, i.e.. 



rank 



B 



AB 
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where 



A 



-u 




1 







, B = 






u 







1 



Theorem 7: An ensemble of haraionic oscillators modeled as in (flTI) is ensemble controllable 
on Ll{D). 

Proof. Without loss of generality, we consider the frequency distributes in a symmetric domain 
Dg = since the system (flTI) with cu E [uji,uj2] can be readily transformed to a frame 

with LU E Dg hy a simple change of coordinate. Let's rewrite (fTT]) as X = uiilX + BU, where 

-1 

1 



Let X(t) = exp(—Lj^lt)X, then we obtain the differential equation in the new coordinate, 

X = (uj — cd)^lX + exp(—iunt)BU, with frequencies u = to — cu E [ui — lj,uj2 — Co]. Taking 
Lj = (uji + co'2)/2, then we have 

where u{t) = u{t) cos(u;t) + v{t) sin(u;t), v{t) = —u{t) sin(u;t) + v{t) cos(tZ't), v E [—(3, (3], and 
(3 = {uj2-uj,)/2. 



-u 










V 





Let 



where % 



pit, u) = x(t, u) + iy(t, u), 
a(t) = u{t) + if (t), 

-1. The system (flTI) can then be written as 

uj) = iup{t, uj) + a{t), 



with p{0,co) = x(0,ti;) + iy{0,uj). By the variation of constants formula, we have at time T 

p{T,iu) = e''^^p{0,uj)+ [ e''^^^~^^a{T)dT, (19) 



for all uj E Dg. This gives 

-T 



p{T,uj) -p{0,uj) = ^{u). 



(20) 
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Let Hi = L2[0,T] and H2 = -L2[— be Hilbert spaces over C. Defining tlie linear operator 
L : Tl^i ^ 7^2 by 

{La){uj)= I e-''^^a{T)dT= I k{uj,T)a{T)dT, (21) 

Jo Jo 

we then have from (|20l) and (|2T]) that 

(La)M = ^M. (22) 
Observe that L is bounded since for every / G Tii, by the Cauchy-Schwartz inequality, 

\\mm<\\{VT 11/11 

Wi)llw2 



(23) 



Therefore, L has the adjoint L* defined by 



/3 /-/g 

(L*g){t)= I k{uo,t)^g{uj)duo= e"^'g{iu)du. 

~P J-f3 



Moreover, since L : Hi ^ H2 and k{uj,T) E L2{[-P,P] x [0,T]), L is a Hilbert-Schmidt 
operator on Hi and hence L is compact (the compactness can also be shown following the 
proof of Proposition [T]). According to Theorem [6l the function a of minimum norm satisfying 
(I22I) is given by 

a{t) = L*z{uj), 



where z satisfies 

and the operator W : H2 H2 is, defined by 

{Wz){uj) = {LL*z){uj) = 



(24) 



(25) 



13 ^i(uj'-uj)T _ I 



/3 



-sin [^{iu - iu')) 



z{uj')duj' 



TX{UJ — Uj') 



z{uj')duj' 



for uj.uj' E A simple change of variables converts (|26|) into 



-1 



z{n')dn' 



(26) 



(27) 



in which c = 17 = |, fi' = ^, and 17, Vt' E [-1, 1]. Notice that the term inside the bracket 
in (l27l) is the kernel of the following integral equation: 



sm[c(r] n )] ^ ^^^^^ ^^^^^ 



(28) 
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where the n*'^ eigenfunction V^„(fi, c) is the well-known prolate spheroidal wave function ipswf), 
and Kn{c) is the associated eigenvalue [39], [40], [41], [42], [43], where k„ > and /t„ — * as 
n ^ oo. Consequently, the n^^ eigenfunction and the corresponding eigenvalue for W as in (|27]) 

■ T 

can be easily represented in terms of ^„ and k„ by 0„ = e~*'^2"^^, and A„ = 27rK„. Note that 
V^n's are orthogonal and complete on -L2[— 1, 1] [39]. Since L is compact, 14^ = LL* is compact. 
It can then be spectral decomposed by the orthonormal basis {0„} applied to (|25] ) 



oo , 

,1^ Wn 



Wz = Y,>^n{z,~^n)k = ^, 0n = e-*-^^, (29) 
n=l ll^^ll 

and this sequence is being uniformly convergent by the spectral theorem [37]. It is also clear 
that {0n} is an orthonormal basis of W . The solution of (|29|) takes the form 

oo ^ 

— ! -^ra 
n=l 

Finally, we show that the above series z(uj) can be truncated to zn^uj) so that — ly^;^!! — > 
as — > oo. Then, we obtain the best approximation of the minimum energy control law = 
L*zn by dill). 

Lemma 1: Given any e > 0, there exists a finite series z^, 

N 



5^^(e,0n)0n, (30) 



Zn ^ 
n=l ^" 

such that 

\\Wz-Wzn\\^0 as N oo, 

where = N(e) depends on the choice of e. 
Proof. By the orthonormality of {(pn}, we get 

N 

WZn = ^(^,0n)<^n- 
n=l 

Let ttn = (pn), and then we have 

oo 

\\Wz -WznW^ = J2K\'^- (31) 

N+l 

Since, by the Bessel's inequality. 



j2K\'<m'<oo, 



n=l 
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the error in (|3T1) can be made in response to the desired e by the selection of = N{e) 
It follows from (El), (El) and ^ that 

aM{t)= j e*"*'^— (32) 



which will steer the system (flTI) from p{{i,uj) to within the ball ^e{p{T,uj)) at time T, where 
Be(p(r,cu)) = {hen2 ■■ \\p{T,uo) - h{u)\\ < e}. In addition, Oat is the best approximation, 
for the given e > 0, of the control law a = u + iv that minimizes the cost functional J as in 
(HI. □ 

We now have ensemble controllability for the system (fTTl) . however, this result fails when 
either u{t) or v{t) is not available. 

Corollary 2: An ensemble of systems as in (fTT]) is not ensemble controllable if either ^(t) = 
or v{t) = 0. 

Proof. Without loss of generality, we suppose now that v(t) = and that the initial state 
{x{0,to),y{0,uj)) = (0,0) for all u E Dg. Note that each element of the ensemble is still 
controllable in this case. Let 

X{t,u) = x(t,uj) — x{t, —u), 
Y{t,uj) = y{t,uj) + y{t,-uj). 

The system described in (flTI) can then be transformed to 



d 


X 




-UJ 




X 




X{0,uj) 







dt 


Y 




UJ 




Y 




Y{0,uj) 








Since the above system is autonomous, it stays at the origin for all t, i.e., {X{t,uj),Y(t,uj)) = 
(0,0). Thus, the system is not ensemble controllable. □ 



B. Simulations 

Here, we provide numerical solutions for a Nit) since it is not of closed form. As shown in 
(|32|) . the ensemble control law aN^t) is synthesized by the set of eigenf unctions {0„} and the 
corresponding eigenvalues {A„} associated with the pswf's. These functions can be approximated 
by the discrete prolate spheroidal sequences (dpss's), denoted as {vt,kiN, W)}, which are defined 
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50 1 • 1 2.6 1 ' ' 1 0.1 




-50 I ^ - 0.5 




-200^ ' 1 -2.5' ' ' ' -0.5 0.5 1 

0.5 1 -2 2 4 x(5,t) 

(a) ' (b) 



Fig. 2. The simulation results of Problem [U for N = 1001, T = 1, and /? = 10. The initial state Xq = (1,0) 
and the target state Xp = (0,0). (a) The optimal control law {u{t),v{t)) for t E [0, 1], and the final states for all 
systems uj E [—10, 10]. (b) The trajectories for uj = —10, u; = Q and a; = 5 following {u{t),v{t)). 



via the solution to the following equation [39], [44] 



N-l ■ 



^ sin \2TrW(t - t')] ...... 

E \r(t-t') = W)vtAN, W), 

t'=o ' 

where Q < W < \ and t = 0, 1, . . . , — 1. It is equivalent to saying that \k{N, W) are the 
eigenvalues of the N x N matrix A whose (t, t')th element is 

sin \27iW(t - 1')] 

iA)t,t' = ^ \ t,t' = 0,l,...,iV-l, (33) 

7r[t — t ) 

and that the N elements of the corresponding eigenvectors for this matrix are in fact subsequences 
of length of the dpss's. Note that \k{N, W) are distinct, real, and ordered non-zero eigenvalues 
such that 

1 > Ao(iV, W) > Xi{N,W) > . . . > XN-iiN, W) > 0, 

and the dpss's are real- valued. Now, we show how to compute aAr(t). We present two cases 
with different initial states for P = 10 and T = 1: 

(1) Consider X{0,uj) = (1,0) and X{l,uj) = (0,0). Then we have p{0,u}) = 1, p{l,u}) = 0, 
and hence, by (|20|) . ^(to) = — 1 is a constant function. 

(2) Consider X(0,cu) = (1,2) andX(l,cu) = (0,0). Then we have p(0, cu) = l + 2i, p(l,cu) = 
0, and hence ^(tu) = — 1 — 2i. 
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Fig. 3. The simulation results of Problem [T] for N = 1001, T = 1, and /? = 10. The initial state Xq = (1,2) 
and the target state Xp — (0,0). (a) The optimal control law {u{t),v{t)) for t £ [0, 1], and the final states for all 
systems uj E [—10,10]. (b) The trajectory for uj = —10 following {u{t),v{t)). (c) The trajectory for uj = 0. (d) 
The trajectory for uj — 5. 

According to the analysis above, the "sine" kernel in (l28l) is replaced by the symmetric matrix A 
as in (l33l) . where W = 2-k(n^i) • Note that the number of harmonic oscillators N must be large 
enough to satisfy W < \ [39]. Here we consider = 1001 and the frequencies are uniformly 
sampled within [—10, 10]. The simulation results are shown in Figure [2l and Figure [H It can be 
seen that following the resulting optimal control laws, the final states of all systems converge 
to a neighborhood of the desired target state, the origin. The trajectories for = — 10, = 0, 
and UJ = h are displayed. Observe that in both cases a strong impulse is implemented initially, 
]ajv(0)| = 191.7 and 428.6, respectively, as shown in Figure IH Practical applications make it 
desirable to design a control with a limited amplitude. This leads to the following problem. 
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Fig. 4. (a) The control amplitude for the case (1). (b) The control amplitude for the case (2). 



C. Constrained Convex Optimization Problem 

In practice, the problem of interest is when the control amplitude is limited. 

Problem 2: Given a fixed time T, find bounded controls u{t) and v{t) satisfying the constraint 
■sju^it) + v'^it) < Amax ^ fof all t G [0,T], wMch will steer an ensemble of systems in 
(fTTl) from an initial state X(0,co') = (1,0) as close as possible, in the L2 sense, to the origin, 
X(T,cj) = (0,0), at time T. 

This problem can be formulated as the following minimization problem 

min / II p(T,cu) - f rfw, (34) 
s.t. u\t)+v\t)<Al,^, (35) 

where p(T, oj) defined in (fT9l) depends on the control a. It follows from (fT9l) and (l34l) that the 
problem can be further simplified as to minimize the following cost functional 

J= f \\ f e-''^"a(r)dr+ ifrftu, 

subject to the constraint (|35l) . By first integrating over uj, we get 

Jo Jo ^-(^ 
/■^2sin(/5r) , ,^ f'^ 2sm{l3a) 

Jo ^ Jo 
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Observe that the imaginary part of the double integration in the expression for J vanishes by 
antisymmetry, i.e. 

2s\Yi[f5{T - a)] 



^0 



T — a 



v{T)u{a) — n(r)t>(cr) 



drda = 0. 



Moreover, the sine kernel is positive definite since 



T pT 



^0 



2sm\3(T - a) 



/3 JO 



T — a 

T 



v{T)v{a)dT da 



'v{T)dT f duj > 0. 



(36) 



According to these observations, we can always minimize J by the appropriate choice of u{t) 
disregarding v{t), because 



r 2sm[l3(T-a)] , , , , , , 
Jo 

T 



4 sin(/5r) , , , 
+ / ^-—^u{T)dT + 2/3. 



T 



Without loss of generality, we assume Amax = 1 and /? = 1 such that the ratio 
original problem described in (|34l) and (l35l) can now be recapitulated as follows: 



1. The 



mm 

u 



T 



sinfr-a) , . , . 2sin(r) ' 
-u[T)u{a)da H u[t) 



IJo 



dr 



s.t. u'^it) < 1. (37) 

Proposition 3: Let S =: u^{t) + v'^(t) < ^max|- ^ local minimum of the cost 

functional J over S is the global minimum. 

Proof. First, observe that 5 is a convex set. Furthermore, the cost function J is quadratic in a 
with positive definite Hessian (see (l36l)). □ 
As a result, the model described in (1371 ) is a convex optimization problem with a unique global 
minimum. We solve this problem numerically as a discrete quadratic optimization problem of 
the form 



min X^HX + 2X^Q 

X 



s.t. 



\xi\ < 1, i 



1,2,..., n, 



(38) 
(39) 
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15 20 25 
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Fig. 5. (a) The optimal control laws foi T — 1, T = tt, T = 5n, and T = IOtt. (b) The distance between the final state and 
the origin, \p{T,Lu) - 0|, of 51 harmonic oscillators for T = 1, T = tt, T = Stt, and T = IOtt. 



where X = {xi,X2 ■ ■ ■ , XnY , h = 0, t„ = T, and 





sin(ti— ti) 


sm{ti—t2) 


sin{ti-t„) 




sin(ti) 




ti-ti 


tl-t2 


tl—tn 




ti 




sin{t2—ti) 


sin{t2—t2) 


sin{t2—t„) 




sin(t2) 


H = 


t2-tl 


t2-t2 


t2—tn 


, Q = 


t2 




sin(t„— ii) 


sin(f„-t2) 


S'm{tn-tn) 




sin(t„) 




tn—tl 


tn—t2 


in in 




tn 



Some simulation results of Problem [2] for various values of T are shown in Figure [5l where 
we assume Amax = 1 and (3 = 1. We consider 51 harmonic oscillators {n = 51) with their 
frequencies uniformly distributed in [—1,1]. The optimal control laws with square wave forms 
are illustrated in Figure I2a). Figure [5tb) shows the L2 distance between the final state and the 
origin of each harmonic oscillator following the corresponding designed control laws. 

V. Conclusion 

In this paper, we studied ensemble control of general time-varying linear systems and derived 
the necessary and sufficient controllability conditions. The key idea of understanding controlla- 
bility relies on investigating the solvability of the integral equation associated with the system 
dynamics, and it is of Fredholm equations of the first kind. We highlighted the role of singular 
systems and spectral theorem in designing ensemble control laws, and an analytical optimal 
control is provided. The work on computing singular values and eigenfunctions of operators will 
be pursued. Another interesting topic is to characterize the researchable set for the system ^ 
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under the constrained controls, i.e., u E U C M™. We plan to continue working on extending 
and generalizing our current results towards the goal of developing a theory of ensemble control. 
We believe the study of ensemble control problems will foster further developments in control 
and systems theory with broader applications such as systems with parameter uncertainties as 
well as system identification. 



Proof. To prove this, we need the following tools. 

Definition 3: Let T^o = ^2^™([si, x [0,T]) be the vector space of all those matrix valued 
functions / whose elements fij{s,t), i = 1, . . . , n, j = 1, . . . , m, are Lebesgue measurable on 
[si, S2] X [0, T] and for which 



Appendix I 



We prove Proposition 1 . 

Proposition 1: The operator L : Hi ^ H2 defined by 




is compact, where 0; s) satisfies for all s E [si, S2] C R 

0; s) = A{t, sMt, 0; s); $(0, 0; s) = I. 




With the inner product for f,ge7io defined by 




Ho is a Hilbert space. 

Let h{s,t) = $(0,t; s 



)B{t, s), and then we have 




We first show that L is a bounded operator. 

Lemma 2: If h{s,t) e Ho, then L e B{Hi,H2). 
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Proof. By Schwarz's inequality. 

\\Lur - 



(^j^ h{s,t)u{t)d?j h{s,t)u{t)dt ] ds 

< \\uf [ [ h{s,tyh{s,t)dtds 

J SI Jo 



Thus, 



||L|| < < oo. 



□ 



(40) 



Lemma 3: Suppose that {0i, 02, • • •} and {ijji, t/'2, • • •} are orthonormal bases for Hi and H2, 
respectively, and 

for (s, t) G [si, S2] X [0, T], e N x N. Then, {"^ij} is an orthonormal basis of Hq. 
Proof. For j, k,m,n & N, 

7si Jo 



rs2 



,{ty(Pn{t)dt 



IprnisYds 



kn 



'si 



tr / 1pj{s)lprn{s)^ds 

J SI 

rs2 

I 'll)m{s)Hj{s)d. 
J Si 



SO that {^ij} is an orthonormal set in Hq. 

Now, suppose that k G Ho be such that (A;, '^ij) = for all i,j G N. Corresponding to this k, 
let K -.Hi^HihQ defined by 



(irw)(s) = /" k{s,t)u{t)dt, ueHi. 
Jo 
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Then, we have for alH,j G N 

= (A;,%) =tr r I k{s,t) rftds 



so rT 



si JO 

S2 



tr 



T 



k{s, t)(f)j{t)dt 



tr j {K(pj)^i{s)^ds 

J Sl 

S2 



iP,{s)\K<i),)ds 

Since ^pi is an orthonormal basis of H2 and 0^ is an orthonormal basis of Hi, it follows that 

Ku = yuE Hi. 

Consequently, A; = a.e. and hence {^ij} is an orthonormal basis for Hq. □ 

Theorem 8: Suppose {Kn} is a sequence of compact operators in B{Hi,'H2) and HKn— i^H 
0, where K is in i3(7ii,7i2)- Then K is compact. 

Proof. See [37]. □ 
According to Lemma [3l h{s,t) can be represented as h = YlTj=i(^' Define 

n 

Then, 

\\h-K\\-^^. (41) 

Let Ln be the integral operator defined on Tii by 

= / hn{s,t)u{t)dt. 
Jo 

Now Ln is a bounded linear operator of finite rank since XniLn C sp{^i, . . . ,^n}, and hence 
Ln is compact. By (|40|) and (|4T]) applied to L — Ln, 

\\L-Ln\\ < \\h-hn\\ ^0. 

This follows L is compact by Theorem [8l Note that the compactness of L can also be shown 
by using the properties of Hilbert-Schmidt operators [37]. □ 
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